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(54) Scanner, printer, memory medium and Image processing method 



(57) There is provided an environment where a 
specified image cannot be obtained, by providing the 
scanner or the input device with a function of judging the 
specified image. 

A scan command is given to a scanner (scanner 
operating command in Fig. 1), then the image corre- 
sponding to the image signal obtained from the scanner 
in response to the command is judged whether it repre- 
sents a specified image (forgery judging module in Fig. 
1), and the result of such judgment is outputted for use 
in processing the image signal (result of forgery judg- 
ment in Fig. 1). 
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Descripti n 

BACKGROUND OF THE INVENTION 
Field of the Invention 

[0001] The present invention relates to a scanner, a 
printer, a memory medium and an image processing 
method. 

Related Background Art 



SUMMARY OF THE INVENTION 
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[0002] As a result of recent improvement in the per- 
formance of the color image reading device utilizing 
CCD or the like (such device being hereinafter called is 
color scanner) and of the color printer, there is increas- 
ing danger of forging or unlawful reproduction of an orig- 
inal of which reproduction is forbidden, such as a 
banknote or a valuable security document, by reading 
such original by the color scanner as the image data 20 
and printing such image data by the color printer. In 
order to prevent such forging, the color copying appara- 
tus consisting of a color scanner and a color printer 
often incorporates a forgery preventing device which 
inhibits the copying operation by recognizing the origi- 25 
nal of which reproduction is forbidden. 
[0003] However, the forgery preventing device 
employed in the color copying apparatus functions only 
in the copying operation, and, if the original forbidden for 
reproduction is once read by a color scanner, the 30 
obtained data can be outputted by a color copying 
apparatus or another color printer through a controller, 
so that the original is eventually forged. 
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[0004] In consideration of the foregoing, an object 
of the present invention is to provide a configuration 
capable of suppressing the forgery operation for the 
image input from a color scanner or the image output to 40 
a color printer. 

[0005] The above-mentioned object can be 
attained, according to a preferred embodiment of the 
present invention, by a printer driver capable of receiv- 
ing an instruction for the printing process, discriminating 4S 
whether an image developed by a rasterizer repre- 
sented a specified (specific) image in response to the 
instruction for the printing process, and outputting the 
result of the discrimination for use in processing the sig- 
nal of the image. 50 
[0006] Another object of the present invention is to 
provide a configuration capable of efficient prevention of 



[0007] Still another object of the present invention is 
to provide novel functions. 55 
[0008] Still other objects of the present invention, 
and the features thereof, will become fully apparent 
from the following detailed description, to be taken in 



conjunction with the accompanying drawings. 
BRIEF DESCRIPTION OF THE DRAWINGS 
[0009] 

Fig. 1 is a view showing the configuration of an 
embodiment of the present invention; 
Fig. 2 is a view showing an example of the configu- 
ration of a first embodiment; 
Fig. 3 is a flow chart showing the function of an 
embodiment of the present invention; 
Fig. 4 is a view showing the configuration of a scan- 
ner system including a host computer; 
Fig. 5 is a view showing an example of the configu- 
ration of second and third embodiments; 
Fig. 6 is a flow chart showing the function of a sec- 
ond embodiment; 

Fig. 7 is a view showing an example of the image of 
enquiry to the user in response to an image input 
forbidden for copying; 

Fig. 8 is a view showing an example of the history 
of operation on an image input forbidden for copy- 
ing; 

Fig. 9 is a flow chart showing the sequence of a for- 
gery preventing process; and 
Fig. 10 is a view showing the configuration of a 
printer system. 

DESCRIPTION OF THE PREFERRED EMBODI- 
MENTS 

[0010] Rg. 1 is a view showing the configuration of 
a scanner system including a host computer and consti- 
tuting an embodiment of the present invention. On the 
host computer, there functions an operating system 102 
(hereinafter written as OS), and a scanner operating 
application 101 functioning thereon provides an operat- 
ing environment for example for an image reading oper- 
ation of a scanner 104. 

[0011] The scanner system shown in Fig. 1 is real- 
ized by a hardware configuration shown in Fig. 2, 
wherein the scanner system is composed of a host 
computer 21 and a scanner 22. The host computer 21 is 
provided with a monitor 201 for displaying GUI of the 
application 101 and the result of image reading from the 
scanner; a mouse 202 and a keyboard 203 for transmit- 
ting the input by the user to the application and the OS; 
an HDD 208 for storing various programs and image 
data; a ROM 206 for storing the basic program of the 
host computer; a RAM 205 for storing read programs 
and images; and a scanner l/F 207 for controlling the 
scanner 22, which are mutually connected by an inter- 
nal bus 209 and controlled by a CPU 204. 
[0012] On the host computer 21 of the above- 
described configuration, the OS and the application 
realize the following processes by the execution, by the 
CPU 204. of the program read from the HDD 208 to the 
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RAM 205. 

[0013] In the following there wilt be explained the 
internal structure of the OS within an extent necessary 
for explaining the present embodiment. In most OS, like 
UNIX, there are separately realized a device driver for 
interfacing with the hardware such as the scanner, and 
a module for managing other user applications and the 
memory. The present embodiment will be explained in 
the following by an OS having such separate structure. 
[0014] The OS 102 is provided, as a module for 
controlling the scanner in addition to controlling the user 
input and other hardware devices, with a scanner driver 
1 03, which, in the present embodiment, is provided with 
a scanner control module 103-1 for directly controlling 
the scanner 104 and a forgery judging module 103-2 for 
judging whether the image fetched from the scanner is 
forbidden for reproduction. The OS is further provided 
with a memory management module 105 for managing 
the image data area. 

[0015] The scanner operating application 101 is 
composed for example of a GUI routine for interfacing 
with the user, a routine for interpreting the user input 
received through the OS 102 and issuing a command 
for operating the scanner, a routine for displaying the 
image read from the scanner; a routine for storing the 
read image on the HDD etc. Such GUI is displayed on 
the monitor 201, and various user inputs, for example 
starting the scanning operation, are entered by the 
mouse 202 and the keyboard 203. 
[0016] The scanner 104 scans and electronically 
reads an original, placed on an original table, by a CCD 
line sensor according to a scanner operation signal from 
the scanner driver, and sends an image signal to the 
host computer according to a predetermined interface 
rule. The image signal is divided into plural color com- 
ponents, for example R, G and B ? each being multi- 
value data of 8 to 12 bits. 

[0017] In the following there will be explained in 
detail the function of the present embodiment of the 
above-described configuration, with reference to the 
attached drawings. Rg. 3 shows an example of the 
operation sequence of the scanner system, on the mod- 
ules of scanner operating application, OS and scanner 
driver. 

[0018] When the user instructs a scan start opera- 
tion through the scanner operating application by a 
manual operation with the mouse/keyboard on the GUI, 
the scanner initiates the image reading. When the appli- 
cation starts the reading operation, the application 
secures, on the RAM, an area for the designated image 
to be read in a step S301 , then issues an image reading 
command specifying the scanner to the OS in a step 
S302, and then enters a waiting state until an image 
reading end notice is received in a step S303. 
[0019] In response to the scan start command, the 
OS calls, in a step S31 1 , a scanner control module cor- 
responding to the specified scanner, then issues a com- 
mand for image reading fr m the scann r, and enters a 



waiting state until the process of the scanner driver is 
terminated. In this operation, the forgery preventing 
module of the OS prepares, as a variable, a judgment 
rate representing whether the image data are of an orig- 
5 inal forbidden for reproduction, and assumes a negative 
initial value for the variable. 

[0020] In response to the scan start command from 
the OS, the scanner control module in the scanner 
driver provides, in a step S321 , the scanner with a scan 

10 start command specific to such scanner. 

[0021] In a step S322, after image reading, the 
image signal received from the scanner is stored in the 
image data area secured by the application on the 
RAM, and the sequence is transferred to the forgery 

is judgment module. 

[0022] The forgery judgment module is provided, as 
a template, with a reproduction forbidden pattern on a 
memory (RAM or ROM) separate from the image mem- 
ory. A step S323 executes pattern matching between 

20 the stored image data and the template, and outputs a 
judgment rate of a value between 0 and 100. An exam- 
ple of such pattern matching consists of calculating the 
mutual correlation between the image data and the tem- 
plate for each color component and outputting the max- 

25 imum value of the correlations obtained for the different 
color components, but the method of such pattern 
matching is not particularly restricted. 
[0023] Also the template for the reproduction forbid- 
den pattern may be provided in plural units, and, in such 

30 case, the pattern matching is conducted between the 
image data and the plural patterns and the obtained 
maximum value can be outputted. In the foregoing, the 
forgery preventing module has been explained as a 
software module, but it may also be realized by a hard- 

35 ware for faster processing. Also in case of the process 
with the software module, the process time can be 
shortened for example by (1) preparing a spatially 
skipped (thinned) image signal from the stored image 
signal and executing judgment by the above-mentioned 

40 forgery judgment module on such skipped image signal, 
or (2) reducing the number of bits of the stored image 
signaJ for example from 8 bits to 5 bits and executing 
judgment by the above-mentioned forgery judgment 
module on the image signal with thus reduced number 

45 of bits. 

[0024] After the image data reading and the forgery 
judging process, the scanner driver informs the OS of 
the end of process and returns the judgment rate 
thereto. The OS receives the notice for the end of proc- 

so ess from the scanner driver in a step S312, and checks, 
in a step S313, the sign of the judgment rate returned 
from the scanner driver. A negative sign indicates that 
the judgment rate remains as the aforementioned initial 
value, so that the scanner driver does not execute the 

55 forgery judgment process or that the scanner driver is 
not equipped with the forgery judgment process. In such 
case, the image data may be of an original forbidden for 
reproduction, so that a step S315 destroys the image 
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data for example by black-out of the image data area 
(conversion to Hack data). Otherwise, for a strict r 
measur , the image data area is for example opened by 
the memory management module to refuse the image 
datarec ption by the OS. s 
[0025] On th other hand, a positive sign indicates 
that the scanner driver has executed the forgery judg- 
ment process, so that the sequence proceeds to a step 
S314, which discriminates whether the image data are 
of an image forbidden tor reproduction by an actual for- io 
gery judgment process. It the judgment rate is larger 
than a threshold value set in advance by the OS, the 
image data are regarded as an image forbidden for 
reproduction, and a step S315 destroys the image data. 
[0026] It is also possible to set plural threshold val- is 
ues by the OS and to vary the measure to be taken 
according to the magnitude of the judgment rate. For 
example if the judgment rate, ranging from 0 to 100, is 
larger than a threshold value 95, the image data can be 
almost certainly an image forbidden for reproduction 20 
and the image data area is opened. This results in a 
strict measure that the application is forcedly closed. In 
such case it is necessary to inform the user of the rea- 
son for such forced closing of the application, there is 
given, on the monitor 201 , a GUI display indicating that 25 
the application is closed by an illegal use and the appli- 
cation is thereafter closed. Also in case the judgment 
rate is larger than a threshold value 80 but smaller than 
95, there can be conceived a measure of blacking out 
the image. Also in such case, there is given, on the 30 
monitor 201, a GUI display indicating the reason of 
image black-out After the judgment of the step S314 or 
the process of the step S315 by the OS, a step S316 
sends a notice for the end of process to the application, 
whereupon the image reading operation of the scanner 35 
system is terminated. 

[0027] In the present embodiment, as explained in 
the foregoing, in acquiring the image signal by the scan- 
ner, there is judged the similarity between the obtained 
image signal and a specified image (image correspond- 40 
ing to a banknote or a valuable security document), and, 
in case of a high similarity (high judgment rate), the 
image signal is destroyed or the application is closed 
according to the result of such judgment, whereby pre- 
vented is the acquisition of a specified image for which 45 
the image formation is prohibited. 
[0028] Also by executing the above-described judg- 
ment at the image signal scanning at the most upstream 
part in the sequence from the scanner through the host 
computer to the printer, there can be securely prevented so 
the acquisition of the image signal, for which the image 
formation is prohibited, in a system consisting of a scan- 
ner, a host computer for image editing and a printer for 
image formation. 

[0029] Also in case there is connected a printer not 55 
equipped with the function of judging a specified image, 
there can be securely prevented the printing of the 
imag signal, corresponding to the image for which th 



image formation is prohibited, by providing the scanner 
driver or the OS with such function of judging the speci- 
fied image. 

[0030] The foregoing mbodiments executes judg- 
ment on the image signal obtained from the scanner 
driver and the OS. 

[0031] However, in the configuration executing the 
judgment of the specified image by the scanner driver 
and the OS, the judgment becomes impossible in case 
of employing a scanner driver not supporting the judg- 
ment of the specified image in the foregoing embodi- 
ment. 

[0032] ft is therefore possible also to provide the OS 
alone with the aforementioned judging function for the 
specified image, thereby executing the judgment of the 
image signal obtained in the scanner by the OS itself. 
[0033] As an alternative method for avoiding the 
above-mentioned drawback that the judgment becomes 
impossible in case of a scanner not supporting the judg- 
ment of the specified image in the foregoing embodi- 
ment, it is also possible to provide the printer driver with 
the aforementioned judging function for the specified 
image, achieved by the scanner driver in the foregoing 
embodiment thereby executing the judgment of the 
specified image by the OS and the printer driver. 
[0034] More specifically, in this case, in response to 
the print command entered from the mouse 202 or the 
keyboard 203. the printer driver execute template 
matching on the image signal to be printed, stored in the 
memory management module of the OS, thereby judg- 
ing whether the image consisting of the image signal is 
a specified image, and informs the OS of a judgment 
rate corresponding to the result of judgment. 
[0035] According to the result of judgment, the OS 
either destroys the image data or forcedly closes the 
application as in the foregoing embodiment 
[0036] Also the template may be provided in plural 
units for judging plural valuable security documents. 
[0037] Also as an alternative method for avoiding 
the above-mentioned drawback that the judgment 
becomes impossible in case of a scanner not support- 
ing the judgment of the specified image in the foregoing 
embodiment, it is also possfole to refer to the version 
information of the scanner driver by the OS, and, rf the 
scanner driver is identified as not supporting the judg- 
ment of the specified image, to display an operation 
image on the monitor 201 for requesting the user to 
download a scanner driver supporting the judgment of 
the specified image through a network (for example 
Internet). Also in the aforementioned case where the 
judgment rate is negative, it is possible to display an 
operation image on the monitor 201 for requesting the 
user to download a scanner driver having the forgery 
judgment module. 

[0038] The scanner driver supporting the judgment 
of the specified image can be downloaded by a manual 
instruction of the user in response to such operation 
image. 
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[0039] Also in the foregoing embodiment, there Is 
adopted the template matching on the image signal 
after spatial pixel skipping or after reduction of the 
numb r of pixels, in order to reduce the judgment proc- 
ess time. 

[0040] As an alternative method of increasing the 
speed of judgment process, there can be adopted a 
configuration of preparing a template for a part of the 
specified image (for example a watermark portion, a 
number portion or a stamp portion in case of a Japa- 
nese banknote) and transmitting the high judgment rate 
to the OS at a timing when such part of the specified 
image is judged, whereby the judgment can be com- 
pleted without judging the entire image signal corre- 
sponding to the specified image but executing the 
judgment only on the above-mentioned part. 
[0041] Thus the time required for judgment can be 
shortened despite of the judgment process executed by 
a software process. 

[0042] Also an even faster judgment process is pos- 
sible by employing the image signal subjected to spatial 
pixel skipping or reduction in the number of pixels as in 
the foregoing embodiment and adopting the above- 
mentioned configuration of utilizing the template corre- 
sponding to a part of the specified image and outputting 
the high judgment rate at the completion of judgment of 
the above-mentioned part, instead of executing judg- 
ment on the entire image signal corresponding to the 
specified image. 

[0043] Furthermore, as the probability of finding the 
specified image among the scanned images is gener- 
ally low in most cases, it is possible to execute the 
approximate judgment with such high-speed method, 
and, if the judgment rate is high in such approximate 
judgment, to read the image signal without skipping 
from RAM in an image portion corresponding to the 
template in the above-mentioned approximate judgment 
and to execute the fine judgment with a separate tem- 
plate without data skipping prepared for the fine judg- 
ment, thereby achieving high-speed judgment and 
obtaining secure result for the image which is doubted 
as a specified image. 

[0044] Also, the accuracy of judgment of the speci- 
fied image may be deteriorated if a part thereof is 
employed as the template for judging such specified 
image. 

[0045] It is therefore possible to prepare a template 
corresponding to a portion of the specified image and 
another template corresponding to another portion of 
the specified image, and, if the judgment rate is high in 
the judgment employing the former template corre- 
sponding to a portion of the specified image, to execute 
the judgment with the another template (time-shared 
judgment) and to destroy the image data only if the 
judgment rates exceed the threshold values in both tem- 
plates, thereby reducing the probability of erroneous 
judgment and realizing highly accurate judgment. 
[0046] The foregoing embodiments have be n 



explained by flow charts indicating the process 
sequence, but the present invention naturally includes 
also a computer readable memory medium capable of 
generating in succ ssion codes corresponding to such 
5 process sequence. 

[0047] Also the foregoing embodiments have been 
explained by a conf iguration of obtaining the image sig- 
nal from the scanner. 

[0048] However the present invention is naturally 
w effective also in case of acquiring image signal from var- 
ious input or reproduction devices such as digital cam- 
era, digital camcorder, compact disk, mini disk, DVD, 
film scanner etc., for executing judgment by the driver 
and OS of such input or reproduction device as to 
15 whether such image signal belongs to a valuable secu- 
rity document. 

[0049] As explained in the foregoing, the above- 
described configuration is adapted to output a scan 
command to the scanner, to judge whether the image, 

20 corresponding to the image signal obtained from the 
scanner in response to the scan command, represents 
a specified image, and to output the result of judgment 
for use in the processing of the image signal. Therefore, 
for example in a sequence consisting of a scanner, then 

25 a host computer and a printer, the above-mentioned 
judgment is executed in the most upstream timing of 
acquiring the image signal, thereby securely preventing 
the acquisition of the image signal corresponding to the 
specified image in a system consisting of a scanner for 

so image data acquisition, a host computer (editing appa- 
ratus) for editing process and a printer for image forma- 
tion. Also there can be achieved high-speed and 
accurate judgment. 

[0050] Also the function of judging the specified 
35 image can be provided even if the scanner does not 
support the judgment of the specified image. 
[0051] Also the function of judging the specified 
image can be provided corresponding to various input 
devices. 

40 [0052] Also there is provided an operating system 
capable of acquiring the result of judgment indicting 
whether the image signal obtained by scanning repre- 
sents the specified image and executing a process 
according to thus acquired result of judgment, whereby 

45 the process in the operating system can be securely 
based on the result of judgment of the specified image. 

[Second embodiment] 

so [0053] Fig. 4 is a view showing the conf iguration of 
a scanner system including a host computer and consti- 
tuting a second embodiment of the present invention. 
On the host computer, there functions an operating sys- 
tem 1102 (hereinafter written as OS), and a scanner 

55 operating application 1 1 01 functioning thereon provides 
an operating environment for example for an image 
reading operation of a scanner 1 104. 
[0054] The scanner system shown in Fig. 4 is real- 
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ized by a hardware configuration shown in Fig. 5. 
[0055] Referring to Fig. 5 the scanner system is 
composed of a host computer 121 and a scanner 122. 
The host comput r 121 is pr vtded with a monitor 1201 
for displaying GUI of the application 1 101 and the result 
of imag reading from the scanner; a mouse 1202 and 
a keyboard 1203 for transmitting the input by the user to 
the application 1101 and the OS 1 1 02; an HDD 1208 for 
storing various programs and image data; a ROM 1206 
for storing the basic program of the host computer; a 
RAM 1205 for storing read programs and images; and a 
scanner l/F 1207 for controlling the scanner 122, which 
are mutually connected by an internal bus 1209 and 
controlled by a CPU 1204. On the host computer 121 of 
the above-described configuration, the OS 1102 and 
the scanner operating application 1101 are realized by 
the execution, by the CPU 1204, of the program read 
from the HDD 1 208 to the RAM 1 205. 
[0056] In the following there will be explained the 
internal structure of the OS 1 102 within an extent nec- 
essary for explaining the second embodiment. In most 
OS, like UNIX, there are separately realized a device 
driver for interfacing with the hardware such as the 
scanner, and a module for managing other user applica- 
tions and the memory. The present embodiment will be 
explained in the following by an OS having such sepa- 
rate structure. 

[0057] The OS 1 102 is provided, as a module for 
controlling the scanner in addition to controlling the user 
input and other hardware devices, with a scanner driver 
1103. which, in the present embodiment, is provided 
with a scanner control module 1103-1 for directly con- 
trolling the scanner 1 104 and a forgery judging module 
1 103-2 for judging whether the image fetched from the 
scanner is prohibited for reproduction. The OS is further 
provided with a memory management module 1 105 for 
managing the image data area. 
[0058] The scanner operating application 1101 is 
composed for example of a GUI routine for interfacing 
with the user, a routine for interpreting the user input 
received through the OS 1 102 and issuing a command 
for operating the scanner, a routine for displaying the 
image read from the scanner, a routine for storing the 
read image on the HDD etc. 
[0059] The scanner 1104 scans and electronically 
reads an original, placed on an original table, by a CCD 
line sensor according to a scanner operation signal from 
the scanner driver 1 103, and sends an image signal to 
the host computer according to a predetermined inter- 
face rule. The image signal is divided into plural color 
components, for example R, G and B, each being multi- 
value data of 8 to 12 bits. 

[0060] In the following there will be explained in 
detail the function of the present embodiment of the 
above-described configuration, with reference to the 
attached drawings. Fig. 6 shows an example of the 
operation sequence of the scann r system, on the mod- 
ules of scanner operating application 1101, OS 1102 



and scanner driver 1 103. 

[0061] When the user instructs a scan start opera- 
tion through the scanner operating application 1101 by 
a manual operation with the mouse 1202 or the key- 

5 board 1203 on the GUI (graphical user interface), the 
scann r initiates th image reading. When the scann r 
operating application starts the reading operation, the 
application secures, on the RAM, an area for the desig- 
nated image to be read in a step S1301, then issues an 

jo image reading command specifying the scanner to the 
OS in a step S1302, and then enters a waiting state until 
an image reading end notice is received in a step 
S1303. 

[0062] In response to the scan start command, the 

is OS 1 1 02 calls, in a step S1 31 1 , a scanner driver mod- 
ule corresponding to the specified scanner, then issues 
a command for image reading from the scanner, and 
enters a waiting state until the process of the scanner 
driver 1103 is terminated. In this operation, the forgery 

20 preventing module of the OS prepares, as a variable, a 
judgment rate representing whether the image data are 
of an original forbidden for reproduction. 
[0063] In response to the scan start command from 
the OS 1 102, the scanner control module 1 103-1 in the 

25 scanner driver provides, in a step S1321, the scanner 
with a scan start command specific to such scanner. In 
a step SI 322, after image reading, the image signal 
received from the scanner is stored in the image data 
area secured by the application, and the sequence is 

30 transferred to the forgery judgment module 1 1 03-2. 
[0064] The forgery judgment module 1 1 03-2 is pro- 
vided, as a template, with a reproduction forbidden pat- 
tern on a memory (RAM or ROM) separate from the 
image memory. A step S1323 executes pattern match- 

35 ing between the stored image data and the template, 
and outputs a judgment rate of a value between 0 and 
100. An example of such pattern matching consists of 
calculating the mutual correlation between the image 
data and the template for each color component and 

40 outputting the maximum value of the correlations 
obtained for the different color components, but the 
method of such pattern matching is not particularly 
restricted. Also the template for the reproduction forbid- 
den pattern may be provided in plural units, and, in such 

45 case, the pattern matching is conducted between the 
image data and the plural patterns and the obtained 
maximum value can be outputted. In the foregoing, the 
forgery preventing module has been explained as a 
software module, but it may also be realized by a hard- 

50 ware for faster processing. Also in case of the process 
with the software module, the process time can be 
shortened for example by (1) preparing a spatially 
skipped image data from the aforementioned image 
data and executing template matching in the above- 

55 mentioned forgery judgment module between such 
image data and the reproduction forbidden pattern (pat- 
tern prohibited for reproduction, corresponding to the 
image data after skipping), or (2) reducing the number 
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of bits of the stored image data and executing template 
matching by the above-mentioned forgery judgment 
module with the reproduction forbidden pattern (pattern 
prohibited for reproduction, corresponding to the image 
data after bit number reduction). s 
[0065] After the image data reading and the forgery 
judging process, the scanner driver informs the OS of 
the end of process and returns the judgment rate 
thereto. 

[0066] The OS receives the notice for the end of 10 
process from the scanner driver in a step S1312, and 
discriminates, in a step S1313, whether the image data 
are of an image forbidden for reproduction by an actual 
forgery judgment process, tf the judgment rate is larger 
than a threshold value set in advance by the OS, the is 
image data are regarded to have possibility as an image 
forbidden for reproduction, and the sequence proceeds 
to a step S1314 for forgery preventing control. 
[0067] Fig. 9 is a view showing an example of the 
process flow of the forgery preventing process S131 4. A 20 
step S1601 starts the process and a step S1601 dis- 
plays a user input image as shown in Fig. 7 on a monitor 
1 109 through a display driver 1107. In this manner, in 
case the image entered from the scanner has the prob- 
ability that it is prohibited for reproduction, the display 2s 
asks the user whether he really wants to read the 
image. A step S1602 checks whether the user input is 
"yes" or "no", and, in case of "yes" (in case of image 
reading), an operation history as shown in Fig. 8 is 
stored in the HDD 1 108. In case of "no" (if image read- so 
ing is canceled), a step S1603 releases the memory 
storing the image, thereby prohibiting the image read- 
ing. 

[0068] After the above-described process, a step 
S1315 sends a notice for the end of process to the $6 
application, whereby the image reading operation of the 
scanner system is terminated. 
[0069] In the present embodiment, as explained in 
the foregoing, at the acquisition of the image signal by 
the scanner, there is judged the similarity between the 40 
image signal and the specified image (corresponding to 
a valuable security document such as banknote) and 
the result of judgment can be informed to the operator 
[0070] Consequently, in case the image prohibited 
for reproduction is read just for a mischievous fun of the 45 
operator, an alarm can be given to the operator. 
[0071] However, in case the image reading is exe- 
cuted even after the above-mentioned warning is given, 
the prevention of the forging action is not sufficient by 
recording the history as explained above. so 
[0072] Therefore, in the present embodiment, the 
forgery preventing module 1106 has a configuration 
capable, in case of storing the image data, obtained by 
reading the reproduction prohibited image judged by the 
above-described judgment in the HDD 1 208 of the host ss 
computer 121, of adding information indicating that the 
image data represent an image which is prohibited for 
reproduction. 



[0073] Also the printer driver or the printing device 
is given a function of judging such added information 
and executes a forgery preventing process such as 
blacking out the formed image, whereby the forging 
action can be prevented. 

[0074] Also the added information can be securely 
added to the image data by adopting such an image 
data recording format that the added information is not 
removed even in case the image data are copied an 
external memory medium (such as a floppy disk, an 
optical disk, a mini disk an MO etc.). Such secure addi- 
tion to the image data can be achieved by adding the 
information as an digital watermark to the image data. 
[0075] Therefore, for example in a sequence con- 
sisting of a scanner, then a host computer and a printer, 
the above-mentioned judgment is executed in the most 
upstream timing of scanning the image signal, thereby 
securely preventing the acquisition of the image signal 
corresponding to the image which is prohibited for 
reproduction, in a system consisting of a scanner for 
image data acquisition, a host computer (editing appa- 
ratus) for editing process and a printer for image forma- 
tion. Also there can be achieved high-speed and 
accurate judgment. 

[0076] Also the printing of the image signal, corre- 
sponding to the image prohibited for reproduction, can 
be securely prevented, even in case a printer not sup- 
porting the function of judging the specified image is 
connected, by providing the scanner driver or the OS 
with such function of judging the specified image. 

[Third embodiment] 

[0077] Fig. 10 shows the configuration of a third 
embodiment of the present invention, which executes 
forgery prevention by a printer driver 1703 and an OS 
1702 in an image processing system consisting of a 
host computer and a printer. As in the second embodi- 
ment, on the host computer, there functions an operat- 
ing system 1702 (CS), and an application 1701 
functioning thereon provides an operating environment 
such as an image output operation to a printer 1 704. 
[0078] Also as in the scanner system shown in Fig. 
4, the printer system shown in Fig. 10 is realized by a 
hardware configuration shown in Fig. 5. 
[0079] Referring to Fig. 10, the printer system is 
composed of a host computer 121 and a printer 123. 
The host computer 121 is provided with a monitor 1201 
for displaying GUI of the application 1701 and the result 
of image reading from the scanner; a mouse 1202 and 
a keyboard 1 203 for transmitting the input by the user to 
the application and the OS; an HDD 1208 for storing 
various programs and image data; a ROM 1206 for stor- 
ing the basic program of the host computer; a RAM 
1205 for storing read programs and images; and a 
printer l/F 1210 for controlling the printer 123, which are 
mutually connected by an internal bus 1209 and control- 
led by a CPU 1204. 
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[0080] On the host computer 121 of the above- 
described configuration, the OS and the application are 
realized by the execution, by the CPU 1204, of the pro- 
gram read from the HDD 1208 to the RAM 1205. The 
OS 1702 is provided, as a module for controlling the 5 
printer in addition to controlling th user input and other 
hardware devices, with a printer driver 1703, which, in 
the present embodiment, is provided with a rasterizer 
1 703-1 for generating image data suitable for the printer 
1704, an image memory 1703-2 for storing the gener- ;<> 
ated image data, and a forgery judging module 1703-3 
for judging whether the rasterized image is prohibited 
for reproduction. The result of forgery judgment, output- 
ted from the forgery judging module, is transferred to a 
forgery prevention control module 1705, which in ? 5 
response executes a process for preventing or sup- 
pressing the forging action. 

[0081] The OS 1702 is also provided with a print 
spooler 1 709 for executing control for outputting the ras- 
terized image to the printer. In the foregoing, the raster- 20 
izer, image memory and forgery judging module are 
supposed to be executed by the printer driver, namely 
realized by a software process, but these may be also 
executed in the printer 1704. In such case, the result of 
forgery judgment executed in the printer may be 25 
returned to the forgery prevention control module 1 705. 
[0082] In the following there will be explained the 
flow of the forgery preventing process in the present 
embodiment. 

[0083] In response to a print start command 30 
entered by a manual operation with the mouse 1202 or 
the keyboard 1203 on the GUI (graphical user interface) 
displayed on the monitor 1708, the OS 1702 instructs 
the printer driver 1703 to print the data received from 
the application 1701. In response to the print instruc- 35 
tion, the printer driver 1 703 causes the rasterizer 1 703- 
2 to develop the document to be printed as image data 
and stores the image data in the image memory 1703- 
2. The stored image is transferred to the forgery judging 
module 1703-2 and the print spooler 1709, which 40 
respectively start the forgery judging process and the 
printing process. The forgery judging module judges, as 
in the second embodiment, whether the image to be 
printed includes a pattern prohibited for reproduction, 
and sends the judgment rate to the forgery prevention 45 
control module 1705. which compares the threshold 
value set in advance by the OS with the judgment rate, 
and, if the latter is larger, display an alarming dialog as 
shown in Fig. 7 on the monitor 1 708. If the user decides 
not to execute printing in response to the displayed dia- so 
log, a spoofing interruption command is supplied to the 
printer spooler 1704 to terminate the printing process. 
In case the user decides to execute printing in response 
to the displayed dialog, an operation history information 
as shown in Fig. 8 is stored in 1706 whereupon the ss 
printing process is terminated. 
[0084] For a high judgment rate, the forgery pre- 
venting module may display interruption f printing on 



th monitor 1 708 and issue a spooling interruption com- 
mand to the printer spooler 1704, instead of alarm dis- 
play. 

[0085] In the present embodiment there has been 
explained a configuration in which the host computer 
and the printer ar connected in a one-to-one relation- 
ship, but the forgery judgment may also be executed by 
the OS including the printer driver, in a configuration 
where plural host computers are connected to a printer 
through a network. 

[0086] The forgery judging configuration adopted in 
the printer allows to judge the forgery in the same man- 
ner as in the OS. 

[0087] However, the network printer is occupied 
during the judgment of the image data representing the 
image prohibited for reproduction, and such situation is 
undesirable for the operators of other host computers. 
[0088] On the other hand, the forgery judgment 
executed in the OS is effective in preventing unneces- 
sary occupation of the printer. 
[0089] Also the forgery judgment in the OS realizes 
secure prohibition of reproduction even in case of 
employing a printer not supporting the function of judg- 
ing the image prohibited for reproduction. 
[0090] In the foregoing second and third embodi- 
ments there has not been explained the number of tem- 
plates, but it is also possible, in these embodiments, to 
prepare plural templates corresponding to the valuable 
security documents of plural kinds, thereby judging 
such documents of plural kinds. 
[0091] Also as an alternative method for avoiding 
the above-mentioned drawback that the judgment 
becomes impossible in case of a scanner (or printer) 
driver not supporting the judgment of the specified 
image in the foregoing embodiments, it is also possible 
to refer to the version information of the scanner (or 
printer) driver by the OS, and, if the scanner (or printer) 
driver is identified as not supporting the judgment of the 
specified image, to display an operation image on the 
monitor 1201 for requesting the user to download a 
scanner (or printer) driver supporting the judgment of 
the specified image through a network (for example 
Internet). 

[0092] The scanner (or printer) driver supporting 
the judgment of the specified image can be downloaded 
by a manual instruction of the user in response to such 
operation image. 

[0093] Also in the foregoing embodiment there is 
adopted the template matching on the image signal 
after spatial pixel skipping or after reduction of the 
number of pixels, in order to reduce the judgment proc- 
ess time. 

[0094] As an alternative method of increasing the 
speed of judgment process, there can be adopted a 
configuration of preparing a template for a part of the 
specified image (for example a watermark portion, a 
number portion or a stamp portion in case of a Japa- 
nes banknote) and transmitting the high judgment rate 
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to the OS at a timing when such part of the specified 
image is judged, whereby the judgment can be com* 
pleted without judging the entire image signal corre- 
sponding to the specified image but executing the 
judgment only on the above-mentioned part. 
[0095] Thus the time required for judgment can be 
shortened despite of the judgment process executed by 
a software process. 

[0096] Also an even faster judgment process is pos- 
sible by employing the image signal subjected to spatial 
pixel skipping or reduction in the number of pixels as in 
the foregoing embodiment and adopting the above- 
mentioned configuration of utilizing the template corre- 
sponding to a part of the specified image and outputting 
the high judgment rate at the completion of judgment of 
the above-mentioned part, instead of executing judg- 
ment on the entire image signal corresponding to the 
specified image. 

[0097] Furthermore, as the probability of finding the 
specified image among the scanned images is gener- 
ally low in most cases, it is possible to execute the 
approximate judgment with such high-speed method, 
and, if the judgment rate is high in such approximate 
judgment, to read the image signal without skipping 
from RAM in an image portion corresponding to the 
template in the above-mentioned approximate judgment 
and to execute the fine judgment with a separate tem- 
plate without data skipping prepared for the fine judg- 
ment, thereby achieving high-speed judgment and 
obtaining secure result for the image which is doubted 
as a specified image. 

[0098] Also, the accuracy of judgment of the speci- 
fied image may be deteriorated if a part thereof is 
employed as the template for judging such specified 
image. 

[0099] h is therefore possible to prepare a template 
corresponding to a portion of the specified image and 
another template corresponding to another portion of 
the specified image, and. if the judgment rate is high in 
the judgment employing the former template corre- 
sponding to a portion of the specified image, to execute 
the judgment with the another template (time-shared 
judgment) and to destroy the image data only if the 
judgment rates exceed the threshold values in both tem- 
plates, thereby reducing the probability of erroneous 
judgment and realizing highly accurate judgment 
[0100] The foregoing embodiments have been 
explained by flow charts indicating the process 
sequence, but the present invention naturally includes 
also a computer readable memory medium capable of 
generating in succession codes corresponding to such 
process sequence. 

[0101] Also the foregoing embodiments have been 
explained by a configuration of obtaining the image sig- 
nal from the scanner. 

[0102] However the present invention is naturally 
effective also in case of acquiring image signal from var- 
ious input or reproduction devices such as digital cam- 



era, digital camcorder, compact disk, mini disk, DVD. 
film scanner etc., for executing judgment by the driver 
and OS of such input or reproduction device as to 
whether such image signal belongs to a valuable secu- 

5 ritydocum nt. 

[0103] As explained in the foregoing, there can be 
provided the function of judging the specified image, 
even if the printer does not support the judgment of the 
specified image. 

10 [0104] Also there can be provided the function of 
judging the specified image, corresponding to various 
input devices. 

[0105] Also there is provided an operating system 
capable of acquiring the result of judgment indicating 

is whether the image corresponding to the image signal 
obtained by a print instruction represents the specified 
image and outputting a signal for executing a process 
according to thus acquired result of judgment, whereby 
the process in the operating system can be securely 

20 based on the result of judgment of the specified image. 
[01 06] Also the foregoing embodiment is adapted to 
send an image signal generation command to an input 
device, to judge whether the image corresponding to 
the image signal obtained from the input device in 

25 response to the above-mentioned command represents 
a specified image, and to output a signal for displaying 
the result of the judgment on the display unit whereby 
the operator can be informed of the result of the judg- 
ment whether the image corresponding to the image 

ao signal represents a specified image. 

[01 07] Also the foregoing embodiment is adapted to 
judge whether the image corresponding to the image 
signal represents a specified image, and, if the judg- 
ment identifies that the above-mentioned image is a 

35 specified image, to add information indicating that the 
above-mentioned image is a specified image, in storing 
thus judged image data, so that the information can be 
added at the storage of thus judged image. Such infor- 
mation can be added also at the storage of the judged 

40 image in a memory medium. 

Claims 

1. An image processing method for use in a scanner 
45 driver, comprising steps of: 

outputting a scanning command to a scanner; 
judging whether an image corresponding an 
image signal obtained from the scanner in 
so response to the command represents a speci- 

fied image; and 

outputting a result obtained in said judging step 
so as to use the result in a processing of the 
image signal. 

55 

2. A method according to claim 1, wherein said out- 
putting step outputs to an op ration system execut- 
ing the process on th image signal according to 
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the r suit obtained in said judging step. 

A method according to claim 1. wherein said judg- 
ing step executes judgement using template match- 
ing. 5 



4. A method according to claim 1 , wherein a process 
of obtaining the image signal from the scanner is 
executed by a scanner module, and the process of 
judging whether the image corresponding to the w 
image signal represents the specified image is exe- 
cuted by a forgery preventing module. 

5. A method according to claim 1, wherein said judg- 
ing step executes judgement on the image corre- is 
sponding to the image signal and plural specified 
images. 

6. A method according to claim 1 , wherein said judg- 
ing step executes judgement with an image signal 20 
obtained by spatial thinning of the image signal. 

7. A method according to claim 1 , wherein said judg- 
ing step executes judgement executed with an 
image signal obtained by reducing the number of 25 
bits of the image signal. 



8. 



A method according to claim 1, wherein said judg- 
ing step terminates judgement when there is 
obtained a high judgment rate indicating that the 
image corresponding to the image signal obtained 
from the scanner represents the specified image. 

A method according to claim 1, wherein said judg- 
ing step executes judgement with an image signal 
obtained by spatiai thinning of the image signal, 
and, if the result obtained in said judging step indi- 
cates a high probability of a specified image, said 
judging step executes judgement with the image 
signal without thinning. 
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10. A method according to claim 9, wherein said judg- 
ment with the unthinned image signal is executed 
by using only the image signal in an area containing 
an object of judgment within the thinned image sig- 
nal. 

11. A method according to claim 1, wherein said judg- 
ing step execute second judgement when a high 
judgment rate is obtained in a first judgment in two 
kinds of judgements provided for a same specific 
image. 

12. A computer readable memory medium which 
stored codes for executing the method according to 55 
claim 1. 

13. An operating system for obtaining a result of judg- 
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m nt indicating wh ther an image corr sponding to 
an image signal obtained by scanning represents a 
specified image; and 

executing a process according to the obtained 
result of judgment. 

14. An operating system according to claim 13, wherein 
said judgment is executed in a scanner driver. 

1 5. An operating system according to claim 1 4, wherein 
information indicating whether said judgment has 
been executed is obtained from said scanner driver. 

1 6. An operating system according to claim 13, wherein 
said process is a working on said image signal. 

17. An operating system according to claim 13, wherein 
said process is a process of ending an application 
functioning on said operating system. 

1a An image processing method for use in an input 
device comprising steps of: 

outputting an image signal generating com- 
mand to an input device; 
judging whether an image corresponding to the 
image signal obtained from said input device in 
response to said command represents a spec- 
ified image; and 

outputting a result obtained in said judging step 
for use for a process of said image signal. 

19. A method according to claim 18, wherein said input 
device is a digital camera, a digital camcorder, a 
film scanner, a compact disk, a minidisk or a DVD. 

20. A computer readable memory medium which 
stored codes for executing the process according to 
claim 18. 

21. An image processing method for use in a printer 
driver comprising the steps of: 

receiving an instruction for a printing process; 
judging whether an image corresponding to an 
image signal developed represents a specified 
image according to the printing process; and 
outputting a result obtained in said judging step 
so as to use the result in a process of said 
image signal. 

22. An image processing method for use in a printer 
driver according to claim 21 , 

wherein a forgery preventing module in an operat- 
ing system outputs an instruction for executing a 
predetermined display to a display driver according 
to th result obtained in said judging step. 
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23. An image processing method for use in a printer 
driver,according to claim 21 , 

wherein a forgery preventing module in an operat- 
ing system outputs an instruction for terminating a 
spooling operation according to the result obtained 
in said judging step. 

24. An image processing method for use in a printer 
driver according to claim 21 , 

wherein said judging step execute judgement using 
template matching. 

25. An image processing method for use in a printer 
driver according to claim 22, 

wherein said predetermined display indicates that 
the image is an image of which reproduction is 
inhibited. 

26. An image processing method for use in a printer 
driver according to claim 25, 

wherein when an instruction for printing is issued 
after the display, log information is stored in mem- 
ory means. 

27. An image processing method for use in a printer 
driver according to claim 21 , 

wherein said judging step executes judgement for 
an image corresponding to the image signal and 
plural specific images. 

28. An image processing method for use in a printer 
driver according to claim 21 , 

wherein said judging step executes judgement with 
an image signal obtained by spatial thinning of the 
image signal. 

29. An image processing method for use in a printer 
driver according to claim 21 , 

wherein said judging step executes with an image 
signal obtained by reducing the number of bits of 
the image signal. 

30. An image processing method for use in a printer 
driver according to claim 21 , 

wherein said judging step terminates when there is 
obtained a high judgment rate indicating that the 
image corresponding to the obtained image signal 
is a specific image. 

31. An image processing method for use in a printer 
driver according to claim 21 , 

wherein, said judging step executes judgement with 
the image signal obtained by spatial thinning of the 
image signal, when a result of the judgement indi- 
cating a high probability of a specific image, said 
judging step executes judgment with the image sig- 
nal without thinning. 



32. An image processing method for use in a printer 
driver according to claim 30, 

wherein said judgment with the unthinned image 
signal is executed with only th image signal of an 
5 area containing an object of judgment in the thinned 
image signal. 

33. An image processing method for use in a printer 
driver according to claim 31 , 

w wherein said judging step executes second judge- 
ment when a high judgment rate is obtained in first 
judgment in two kinds of judgements provided for a 
same specific image. 

is 34. A computer readable memory medium which 
stored codes for executing the method according to 
claim 21. 

35. An operating system for: 

20 

obtainng a result of a judgment whether an 
image corresponding to an image signal 
obtained according to a print instruction repre- 
sents a specific image; 
25 outputting a signal for executing a process 

according said obtained result of judgment. 

36. An operating system according to claim 35, wherein 
said judgment is executed in a printer driver. 

30 

37. An operating system according to claim 35, wherein 
said process is a process for terminating the print- 
ing of the image corresponding to said image sig- 
nal. 

35 

38. An operating system according to claim 35, wherein 
said process is a process for displaying that said 
image is a specified image. 

40 39. An image processing method for use in a driver 
comprising the steps of: 

outputting an image signal generating com- 
mand to an input device; 
45 judging whether an image corresponding to the 

image signal obtained from said input device in 
response to said command represents a spec- 
ified image; and 

outputting a signal for causing a display unit to 
so display a result obtained in said judging step. 

40. An image processing method for use in a driver 
according to claim 39, wherein said input device is 
a digital camera, a digital camcorder, a scanner, a 

55 compact disk, a mini disk, or a DVD. 

41. An image processing method comprising steps of: 
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judging whether an imag corresponding to an 
image signal represents a specific image; and 
adding information indicating that said image is 
the specific imag , to said image signal if 
image data of two image judged as specific 
image is stored when said judgment identifies 
that said image is a specified image. 

42. A method according to claim 41, wherein said 
added information can be recognized by a printer 
driver or a printer. 

43. A method according to claim 41 , wherein said 
added information is also copied when image signal 
is copied to a memory medium. 

44. A method according to claim 41, wherein said 
added information is added as a digital watermark 
to the image signal. 

45. A scanner adapted for outputting an image signal to 
the scanner driver according to claim 1 . 

46. A printer adapted for printing an image from the 
printer driver according to claim 21 . 

47. A computer processing apparatus storing program 
instructions defining an application, an external 
device driver, and an interface between the applica- 
tion and the device driver, wherein the device driver 
is arranged to determine whether image data 
from/to the external device represents a predeter- 
mined image, and the interface is arranged to con- 
trol processing of the image data in dependence 
upon the determination result. 

48. Apparatus according to claim 47, wherein the inter- 
face is part of an operating system. 

49. Apparatus according to claim 47 or claim 48 
wherein the external device is an image reading 
device. 

50. A computer program product for use in an appara- 
tus according to claim 47, comprising instructions 
defining an external device driver, the instructions 
including instructions for causing the driver to deter- 
mine whether image data represents a predeter- 
mined image. 

51. A computer program product for use in an appara- 
tus according to claim 47, comprising instructions 
defining an interface, the instructions including 
instructions for controlling processing of image data 
in dependence upon whether the image data repre- 
sents a predetermined image. 

52. A computer program product according to claim 50 
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or claim 51 , when embodied as a signal conveying 
the instructions. 
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